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DETAILED ACTION 

A. This action is in response to the following communications: Request for 
Continued Examination filed 11/13/2009. 

B. Claims 1-3, 5-12 and 15-25 remains pending. 

Continued Examination Under 37 CFR 1.114 

C. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .1 7(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 

1 1/13/2009 has been entered. 



Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. This application currently names joint inventors. In considering 
patentability of the claims under 35 U.S.C. 1 03(a), the examiner presumes that the 
subject matter of the various claims was commonly owned at the time any inventions 
covered therein were made absent any evidence to the contrary. Applicant is advised 
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of the obligation under 37 CFR 1 .56 to point out the inventor and invention dates of 
each claim that was not commonly owned at the time a later invention was made in 
order for the examiner to consider the applicability of 35 U.S.C. 103(c) and potential 35 
U.S.C. 1 02(e), (f) or (g) prior art under 35 U.S.C. 1 03(a). 

3. Claims 1-3, 5-12 and 15-25 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Chen et al (US Patent 6,249,281), herein referred to as "Chen" in 
view of Vigneaux, Stevan et al. (US Pat. 5,852,435), herein referred to as "Vigneaux" 
and further in view of Chiu, Patrick (US Pat. 7,203,380), herein referred to as "Chiu". 



As for independent claim 1 , Chen teaches an image processing system (310, col. 3, line 
54) for correlating still picture data with video data (col.4, lines 17-19), comprising: a 
video display section (520) for reproducing and displaying the video data on a screen 
(col. 5, lines 41-42); a picture display section (540) for reproducing and displaying the 
still picture data on the screen (col. 5, line 61); a designation section for accepting an 
instruction from a user to designate the still picture displayed on the screen (532 and 
col. 6, lines 12-13); and a correlation section for, upon the instruction entered by the user 
during the reproduction of the video data, correlating the designated still picture data 
with a reproduction time position in the video data (col .6, lines 12-18). 
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Chen does not specifically teach that where the at least one designated item 
(object) correlated with video data (or data objects) are stored with keyword searchable 
data for each still picture; however in the same field of endeavor Vigneaux teaches 
storing keyword searchable data for each data object wherein data objects consist of 
graphics, text and video audio (e.g. Chen's presentation files) at least one of text data of 
the presentation document and voice index data of the video data (col.4, lines 4-23; 
col. 6, lines 5-19 and 41-67: Vigneaux). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to combine Vigneaux's search method option 
for presentation of multimedia into Chen's system for presentation of multimedia 
content; this is true because Vigneaux solves the problem of providing to a user the 
capabilities of viewing the presentation of multimedia content using a user friendly 
graphical interface (col. 2, lines 22-34), one of ordinary skill in the art would recognize 
the variant search function of Vigneaux as being a beneficial addition to Chen's system 
to allow for the expansion of the already similar interface of Vigneaux . 

Chen as modified by Vigneaux does not specifically teach extracting pictures 
from video, however in the same field of endeavor Chiu teaches displaying at least one 
of still picture data extracted from video data figures (4 and 8; col. 7, lines 52-67). It 
would have been obvious to one of ordinary skill in the art at the time of the invention to 
combine Chiu's variant option of sizing multimedia content into the system of Chen as 
modified by Vigneaux, this is true because Chiu solves the problem of providing a user 
interface for presentation of multimedia content (plurality of video data segments) (col.1 , 
lines 62-67). One of ordinary skill in the art would recognize the variant option of Chiu's 
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similar interface (an interface to present multimedia content to a user) would be 
beneficial to be added to Chen's system for purposes of expanding the type of objects 
the interface can present (extracted pictures from video), giving the system an added 
ability to present another type of object that is closely related (extracted pictures and 
videos). 

Note - as for claims 1, 2, 5, 6 and 8 : Vigneaux teaches data stored on a database, this 
data comprises of graphics, text and audio (herein objects) wherein the use of meta- 
data is used (tied to the objects) to make these objects searchable (within a database) 
so the user may interact with the objects on the interface for purpose of 
searching/finding and presenting objects on the interface. Chen teaches the method 
and system of storing and presenting presentation files wherein the presentation files 
comprise that of a presentation of multimedia content, such as slides (graphics), text 
from slides (text) and video (graphics and audio). The combination of Vigneaux into 
Chen provides a system that allows for a variant search function to be implemented into 
a similar system of Chen, wherein this search characteristic allows for the storage of 
meta-data (keywords) wherein these keywords are searchable and tied to objects such 
that objects can be searchable. This reasoning provides that Vigneaux and Chen 
suggest that meta-data is being text data of a presentation document and voice index of 
the video data. Implementing the functions of Vigneaux into Chen provides a 
presentation interface for presenting to the user a Presentation file comprising of video 
(graphics/pictures and audio), text, slides wherein these are objects that can be 
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searched for by the user using Vigneaux search method to find objects that are similar 
as explained. Vigneaux system is setup to find (graphics, audio and text) all of which 
make up the presentation medium of Chen (col.4, lines 4-23; col. 6, lines 5-19 and 41- 
67: Vigneaux). 

Further Chiu is introduced to add an obvious medium type to the object type list 
of Chen. That is Chiu specifically teaches a method capable of extracting still picture 
data from video (moving picture data) for presentation of multiple still picture data on the 
interface (col. 7, lines 52-67). The combination of Chiu into Chen as modified by 
Vigneaux allows for the obvious variant option of adding one more medium type object 
(still picture taken form video) that can make use of the Vigneaux search function and 
presented on the presentation file of Chen as explained above. 
With Chen as the primary reference teaching the main concept of a presentation system 
for presenting objects in a desired format and obvious additions (functions) from 
Vigneaux (providing search function for finding objects of the presentation file) and Chiu 
(providing another object type, still pictures extracted from video) it is evident to one of 
ordinary skill in the art to recognize the exact reference to the immediate claimed 
invention. 

As for independent claim 2, Chen teaches an image processing system for correlating 
still picture data with video data, comprising: (note the analysis of claim 1) 
a registered client including a video display section for reproducing and displaying the 
video data on a screen (fig. 5 and col. 3, line 1), a picture display section for reproducing 
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and displaying the still picture data on the screen, a designation section for accepting an 
instruction from a user to designate the still picture displayed on the screen, and a 
correlation section for, upon the instruction entered by the user during the reproduction 
of the video data, correlating the designated still pictured at a with are production time 
position in the video data (note the analysis of claim 1 ); and a distribution server for 
holding the video data and the still picture data that are correlated with each other, and 
in accordance with a request from a browsing client, providing the video data and the 
still picture data (fig.3, 110 and col.4, lines 40-48). 

Chen does not specifically teach that where the at least one designated item 
(object) correlated with video data (or data objects) are stored with keyword searchable 
data for each still picture; however in the same field of endeavor Vigneaux teaches 
storing keyword searchable data for each data object wherein data objects consist of 
graphics, text and video audio (e.g. Chen's presentation files) at least one of text data of 
the presentation document and voice index data of the video data (col.4, lines 4-23; 
col. 6, lines 5-19 and 41-67: Vigneaux). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to combine Vigneaux's search method option 
for presentation of multimedia into Chen's system for presentation of multimedia 
content; this is true because Vigneaux solves the problem of providing to a user the 
capabilities of viewing the presentation of multimedia content using a user friendly 
graphical interface (col. 2, lines 22-34), one of ordinary skill in the art would recognize 
the variant search function of Vigneaux as being a beneficial addition to Chen's system 
to allow for the expansion of the already similar interface of Vigneaux . 
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Chen as modified by Vigneaux does not specifically teach extracting pictures 
from video, however in the same field of endeavor Chiu teaches displaying at least one 
of still picture data extracted from video data figures (4 and 8; col. 7, lines 52-67). It 
would have been obvious to one of ordinary skill in the art at the time of the invention to 
combine Chiu's variant option of sizing multimedia content into the system of Chen as 
modified by Vigneaux, this is true because Chiu solves the problem of providing a user 
interface for presentation of multimedia content (plurality of video data segments) (col.1 , 
lines 62-67). One of ordinary skill in the art would recognize the variant option of Chiu's 
similar interface (an interface to present multimedia content to a user) would be 
beneficial to be added to Chen's system for purposes of expanding the type of objects 
the interface can present (extracted pictures from video), giving the system an added 
ability to present another type of object that is closely related (extracted pictures and 
videos). 



As for dependent claim 3, Chen teaches an image processing system according to 
claim 2, wherein the distribution server (110) distributes, to the browsing client, 
correlation data (330) for video data and still picture data, and provides the still picture 
data requested by the browsing client (col.4, lines 17-19 and 40-48). 
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As for independent claim 5, Chen teaches an image processing method for correlating 
still picture data with video data, comprising the steps of: reproducing and displaying the 
video data on a screen, and reproducing and displaying the still picture data on the 
screen; and in accordance with an instruction entered by a user during the reproduction 
of the video data to designate a still picture, correlating the corresponding still picture 
data with a reproduction time position in the video data (note the analysis of claim 1 
above). 

Chen does not specifically teach that where the at least one designated item 
(object) correlated with video data (or data objects) are stored with keyword searchable 
data for each still picture; however in the same field of endeavor Vigneaux teaches 
storing keyword searchable data for each data object wherein data objects consist of 
graphics, text and video audio (e.g. Chen's presentation files) at least one of text data of 
the presentation document and voice index data of the video data (col.4, lines 4-23; 
col. 6, lines 5-19 and 41-67: Vigneaux). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to combine Vigneaux's search method option 
for presentation of multimedia into Chen's system for presentation of multimedia 
content; this is true because Vigneaux solves the problem of providing to a user the 
capabilities of viewing the presentation of multimedia content using a user friendly 
graphical interface (col. 2, lines 22-34), one of ordinary skill in the art would recognize 
the variant search function of Vigneaux as being a beneficial addition to Chen's system 
to allow for the expansion of the already similar interface of Vigneaux . 



Application/Control Number: 10/625,700 Page 10 

Art Unit: 2179 

Chen as modified by Vigneaux does not specifically teach extracting pictures 
from video, however in the same field of endeavor Chiu teaches displaying at least one 
of still picture data extracted from video data figures (4 and 8; col. 7, lines 52-67). It 
would have been obvious to one of ordinary skill in the art at the time of the invention to 
combine Chiu's variant option of sizing multimedia content into the system of Chen as 
modified by Vigneaux, this is true because Chiu solves the problem of providing a user 
interface for presentation of multimedia content (plurality of video data segments) (col.1 , 
lines 62-67). One of ordinary skill in the art would recognize the variant option of Chiu's 
similar interface (an interface to present multimedia content to a user) would be 
beneficial to be added to Chen's system for purposes of expanding the type of objects 
the interface can present (extracted pictures from video), giving the system an added 
ability to present another type of object that is closely related (extracted pictures and 
videos). 



As for independent claim 6, Chen teaches an image processing method for registering 
still picture data in correlation with video data to a distribution server that provides the 
video data and the still picture data upon the reception of a request from a browsing 
client, the image processing method (col.4, lines 26-39 and col. 3, line 1) comprising the 
steps of: reproducing and displaying video data on a screen, and reproducing and 
displaying still picture data on the screen (fig.5); correlating a corresponding still picture 
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data with a reproduction time position in the video data (fig. 7), in accordance with an 
instruction entered by a user during the reproduction of the video data to designate the 
still picture (col. 6, lines 12-31); and registering the video data and the still picture data 
together with correlation data to the distribution server (fig. 3, 110, 330). 

Chen does not specifically teach that where the at least one designated item 
(object) correlated with video data (or data objects) are stored with keyword searchable 
data for each still picture; however in the same field of endeavor Vigneaux teaches 
storing keyword searchable data for each data object wherein data objects consist of 
graphics, text and video audio (e.g. Chen's presentation files) at least one of text data of 
the presentation document and voice index data of the video data (col.4, lines 4-23; 
col. 6, lines 5-19 and 41-67: Vigneaux). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to combine Vigneaux's search method option 
for presentation of multimedia into Chen's system for presentation of multimedia 
content; this is true because Vigneaux solves the problem of providing to a user the 
capabilities of viewing the presentation of multimedia content using a user friendly 
graphical interface (col. 2, lines 22-34), one of ordinary skill in the art would recognize 
the variant search function of Vigneaux as being a beneficial addition to Chen's system 
to allow for the expansion of the already similar interface of Vigneaux . 

Chen as modified by Vigneaux does not specifically teach extracting pictures 
from video, however in the same field of endeavor Chiu teaches displaying at least one 
of still picture data extracted from video data figures (4 and 8; col. 7, lines 52-67). It 
would have been obvious to one of ordinary skill in the art at the time of the invention to 
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combine Chiu's variant option of sizing multimedia content into the system of Chen as 
modified by Vigneaux, this is true because Chiu solves the problem of providing a user 
interface for presentation of multimedia content (plurality of video data segments) (col.1 , 
lines 62-67). One of ordinary skill in the art would recognize the variant option of Chiu's 
similar interface (an interface to present multimedia content to a user) would be 
beneficial to be added to Chen's system for purposes of expanding the type of objects 
the interface can present (extracted pictures from video), giving the system an added 
ability to present another type of object that is closely related (extracted pictures and 
videos). 



As for dependent claim 7, Chen teaches the image processing method according to 
claim 6, wherein the correlation data is a program (340, col. 3, line 1) for requesting the 
distribution server predetermined still picture data in accordance with the reproduction 
time position in video data (col. 6, lines 12-18 and fig. 7), in accordance with a request 
from a browsing client (col .3, line 1 ), the distribution server provides video data and the 
program for the browsing client, and the browsing client executes the program as the 
video data are reproduced (col.4, lines 32-39 and col. 3, line 4), and requests the 
distribution server still picture data that are correlated with the reproduction time position 
(col.6, lines 12-31). 

As for independent claim 8, Chen teaches a program that permits a computer (fig. 2) to 
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perform an image process for correlating still picture data with video data (col. 3, lines 1- 
4), comprising: displaying a still picture on a screen (fig. 5), accepting an instruction from 
a user to designate a still picture during the reproduction of the video data accepts 
(col. 6, lines 12-18), and correlating the corresponding still picture data with a 
reproduction time position in the video data (fig. 7, col. 6, lines 24-29). 

Chen does not specifically teach that where the at least one designated item 
(object) correlated with video data (or data objects) are stored with keyword searchable 
data for each still picture; however in the same field of endeavor Vigneaux teaches 
storing keyword searchable data for each data object wherein data objects consist of 
graphics, text and video audio (e.g. Chen's presentation files) at least one of text data of 
the presentation document and voice index data of the video data (col.4, lines 4-23; 
col. 6, lines 5-19 and 41-67: Vigneaux). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to combine Vigneaux's search method option 
for presentation of multimedia into Chen's system for presentation of multimedia 
content; this is true because Vigneaux solves the problem of providing to a user the 
capabilities of viewing the presentation of multimedia content using a user friendly 
graphical interface (col. 2, lines 22-34), one of ordinary skill in the art would recognize 
the variant search function of Vigneaux as being a beneficial addition to Chen's system 
to allow for the expansion of the already similar interface of Vigneaux . 

Chen as modified by Vigneaux does not specifically teach extracting pictures 
from video, however in the same field of endeavor Chiu teaches displaying at least one 
of still picture data extracted from video data figures (4 and 8; col. 7, lines 52-67). It 
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would have been obvious to one of ordinary skill in the art at the time of the invention to 
combine Chiu's variant option of sizing multimedia content into the system of Chen as 
modified by Vigneaux, this is true because Chiu solves the problem of providing a user 
interface for presentation of multimedia content (plurality of video data segments) (col.1 , 
lines 62-67). One of ordinary skill in the art would recognize the variant option of Chiu's 
similar interface (an interface to present multimedia content to a user) would be 
beneficial to be added to Chen's system for purposes of expanding the type of objects 
the interface can present (extracted pictures from video), giving the system an added 
ability to present another type of object that is closely related (extracted pictures and 
videos). 

As for dependent claims 9,11,15,17 and 20; Chen in view of Vigneaux teaches 
a system and corresponding medium and method of claims 1 , 2, 5, 6 and 8 but does not 
teach wherein the plural pieces of still picture data are displayed in different sizes, and 
the different sizes are based on the time length of a corresponding section of video 
data; however in the same field of endeavor Chiu teaches wherein the plural pieces of 
still picture data are displayed in different sizes, and the different sizes are based on the 
time length of a corresponding section of video data (figures 4 and 8; col .7, lines 52-67). 
It would have been obvious to one of ordinary skill in the art at the time of the invention 
to combine Chiu's variant option of sizing multimedia content into the system of Chen as 
modified by Vigneaux, this is true because Chiu solves the problem of providing a user 
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interface for presentation of multimedia content (plurality of video data segments) (col.1 , 
lines 62-67). 

As for dependent claims 10,12,16,18 and 1 9; Chen in view of Vigneaux 
teaches a system and corresponding medium and method of claims 1 , 2, 5, 6 and 8 but 
does not teach wherein the plural pieces of still picture data are displayed in different 
sizes, and the different sizes are based on an importance level of a corresponding 
section of the video data; however in the same field of endeavor Chiu teaches wherein 
the plural pieces of still picture data are displayed in different sizes, and the different 
sizes are based on an importance level of a corresponding section of the video data 
(figures 4 and 8; col. 7, lines 52-67). It would have been obvious to one of ordinary skill in 
the art at the time of the invention to combine Chiu's variant option of sizing multimedia 
content into the system of Chen as modified by Vigneaux, this is true because Chiu 
solves the problem of providing a user interface for presentation of multimedia content 
(plurality of video data segments) (col.1, lines 62-67). 

As for dependent claim 21 , Chen teaches an image processing system according to 
claim 1, further comprising a single interface screen that includes the video display 
section, the picture display section, the designation section, and the correlation section 
(col. 5, line 34 - col. 6, line 52; figures 5-7). 
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As for dependent claim 22, Chen teaches an image processing system according to 
claim 2, further comprising a single interface screen that includes the video display 
section, the picture display section, the designation section, and the correlation section 
(col. 5, line 34 - col. 6, line 52; figures 5-7). 

As for dependent claim 23, Chen teaches an image processing method according to 
claim 5, further comprising providing a single interface screen for reproducing and 
displaying the video data, reproducing and displaying the still picture data, and 
correlating the corresponding still picture data (col. 5, line 34 - col. 6, line 52; figures 5- 
7). 

As for dependent claim 24, Chen teaches an image processing method according to 
claim 6, further comprising providing a single interface screen for reproducing and 
displaying the video data, reproducing and displaying the still picture data, 
corresponding the corresponding still picture data, and registering the video data and 
the still picture data (col. 5, line 34 - col.6, line 52; figures 5-7). 

As for dependent claim 25, Chen teaches a recording medium as recited in claim 
8, further comprising providing a single interference screen for displaying the still 
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picture, accepting an instruction from a user to designate the still picture, and correlating 
the corresponding still picture data (col. 5, line 34 - col.6, line 52; figures 5-7). 



(Note :) It is noted that any citation to specific, pages, columns, lines, or figures in the prior art references and 

any interpretation of the references should not be considered to be limiting in any way. A reference is relevant for all it 
contains and may be relied upon for all that it would have reasonably suggested to one having ordinary skill in the art. In 
re Heck, 699 F.2d 1331, 1332-33, 216 USPQ 1038, 1039 (Fed. Cir. 1983) (quoting In re Lemelson, 397 F.2d 1006,1009, 158 
USPQ 275, 277 (CCPA 1968)). 

Response to Arguments 

Applicant's arguments filed 1 1/13/2009 have been fully considered but they are 
not persuasive. 

After careful review of the amended claims (given the broadest reasonable 
interpretation) and the remarks provided by the Applicant along with the cited 
reference(s) the Examiner does not agree with the Applicant for at least the reasons 
provided below: 

A1 . Applicant argues that Chen and Vigneaux does not teach "the plural 
pieces of still pictures data correlated with video data are stored with keyword 
searchable data for each still picture; further "extracting any still pictures extracted form 
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the video" and "the meta data being text data of a presentation document and voice 
index data of the video data". 

R1 . Examiner does not agree, Vigneaux teaches data stored on a database, 
this data comprises of graphics, text and audio (herein objects) wherein the use of 
meta-data is used (tied to the objects) to make these objects searchable (within a 
database) so the user may interact with the objects on the interface for purpose of 
searching/finding and presenting objects on the interface. Chen teaches the method 
and system of storing and presenting presentation files wherein the presentation files 
comprise that of a presentation of multimedia content, such as slides (graphics), text 
from slides (text) and video (graphics and audio). The combination of Vigneaux into 
Chen provides a system that allows for a variant search function to be implemented into 
a similar system of Chen, wherein this search characteristic allows for the storage of 
meta-data (keywords) wherein these keywords are searchable and tied to objects such 
that objects can be searchable. This reasoning provides that Vigneaux and Chen 
suggest that meta-data is being text data of a presentation document and voice index of 
the video data. Implementing the functions of Vigneaux into Chen provides a 
presentation interface for presenting to the user a Presentation file comprising of video 
(graphics/pictures and audio), text, slides wherein these are objects that can be 
searched for by the user using Vigneaux search method to find objects that are similar 
as explained. Vigneaux system is setup to find (graphics, audio and text) all of which 
make up the presentation medium of Chen. 



Application/Control Number: 10/625,700 Page 19 

Art Unit: 2179 

Further Chiu is introduced to add an obvious medium type to the object type list 
of Chen. That is Chiu specifically teaches a method capable of extracting still picture 
data from video (moving picture data) for presentation of multiple still picture data on the 
interface. The combination of Chiu into Chen as modified by Vigneaux allows for the 
obvious variant option of adding one more medium type object (still picture taken form 
video) that can make use of the Vigneaux search function and presented on the 
presentation file of Chen as explained above. 

With Chen as the primary reference teaching the main concept of a presentation 
system for presenting objects in a desired format and obvious additions (functions) from 
Vigneaux (providing search function for finding objects of the presentation file) and Chiu 
(providing another object type, still pictures extracted from video) it is evident to one of 
ordinary skill in the art to recognize the exact reference to the immediate claimed 
invention. 



Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 
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Inquires 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nicholas Augustine whose telephone number is 571- 
270-1056 and fax is 571-270-2056. The examiner can normally be reached on Monday 
- Friday: 9:30am- 5:00pm Eastern. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Weilun Lo can be reached on 571-272-4847. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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Examiner 
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January 29, 2010 
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